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IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND 
COMPUTER READABLE MEDIUM STORING PROGRAM 

This patent application claims priority from a Japanese 
5 patent application No. 2002-188774 filed on June 27 2002, the 
contents of which are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

10 Field of the Invention 

The present invention relates to an image processing 
apparatus, an image processing method, and a computer readable 
medium storing program. More particularly, the present invention 
relates to an image processing apparatus, an image processing 

15 method, and a computer readable medium storing program for 
processing an image based on correlativity between images. 

* 

Description of Related Art 

For judging similarity and correlativity between an image 

20 data and another image data, an apparatus, such as a fingerprint 
identification apparatus or the like, has been used. According 
to the apparatus, the' other image data, of which the correlativity 
with. the image is higher than a predetermined reference value, 
is selected so as to perform user authentication and the like. 

25 However, the apparatus stores the correlativity between one 

image data and a plurality of other image data in association with 
only the one image data. Therefore, the information on the 
correlativity, which has been already judged, is not used 
efficiently when a part of the plurality of other image data is 

30 to be used for another purpose. 

SUMMARY OF THE INVENTION 



Therefore , it is an obj ect of the present invention to provide 
an image processing apparatus, an image processing method and a 
computer readable medium storing thereon program which can solve 
the foregoing problems . The above and other ob j ect s can be achieved 
by combinations described in the independent, claims . The 
dependent claims define further advantageous and exemplary 
combinations of the present invention. 

According to the first aspect of the present invention, there 
is provided an image processing apparatus including: appending 
information generating means for receiving image data and 
generating an appending information based on contents of the image 
data; correlativity judgment means for judging correlativity 
between the image data and another image data including the 
appending information based on the appending information; and 
correlativity information assignment means for assigning 
correlativity information indicating the correlativity to the 
received image data and the other image data. 

Moreover, the image processing apparatus may further include 
maintenance judgment means for judging whether the image data is 
to be maintained based on the correlativity information. 

Moreover, the image processing apparatus may further include 
a communication unit for communicating with another image 
processing apparatuses, and when it is judged that the image data 
is not to be maintained, the maintenance judgment means causes 
the communication unit to transfer the image data to another image 
processing apparatuses. 

Moreover, the maintenance judgment means may add information 
for identifying an image processing apparatus, which is an origin 
of the image data, and the information for identifying another 
image processing apparatus, which is a destination of the image 
data, to the image data as a transference history of the image 



data when the image data is to be transferred. 

Moreover, the image processing apparatus may further include 
appending information attaching means for attaching the appending 
information to the image data. 

Moreover, the image processing apparatus may f urther include 
composite means for composing the image data with the other image 
data based on the correlativity information. 

Moreover, the appending information generating means may 
generate information indicating contents of- the image data as the 
appending information by analyzing the image. 

Moreover, the appending information generating means may 
generate processing conditions for processing the image data as 
the appending information by analyzing the image. 

Moreover, the image processing apparatus may further include 
selection means for selecting the other image data, which is to 
be used for judgment of the correlativity , using at least a part 
of the appending information. 

Moreover, the selection means may repeat to select the 
plurality of other image data until a predetermined number of the 
other image data are selected. 

Moreover, the correlativity judgment means may further judge 
whether the correlativity between the selected other image data 
and the image data is higher than a predetermined value, and 

the selection means may. repeat to select the plurality of 
other image data until the other image data, of which the 
correlativity with the image data is higher than the predetermined 
value, are selected more than a predetermined number. 

According to the second aspect of the present invention, 
there is provided an image processing apparatus, including: 
appending information generating means for generating appending 
information based on contents of an image data when the image data 
is received; correlativity judgment means for judging a 



correlativity between the image data and another image data from 
which the appending information is generated based on the appending 
information; and maintenance judgment means for judging whether 
the image data is to be maintained based on the correlativity. 

According to the third aspect of the present invention, there 
is provided an image processing method, including steps of: 
receiving image data and generating appending information based 
on contents of the image data; judging correlativity between the 
image data and another image data including the appending 
information based on the appending information; and assigning 
correlativity information indicating the correlativity to the 
received image data and the -other image data. 

According to the fourth aspect of the present invention, 
there is provided an image processing method, including steps of: 
generating appending information based on contents of an image 
data when the image data is received; judging a correlativity 
between the image data and another image data from which the 
appending information is generated based on the appending 
information; and judging whether the image data is to be maintained 
based on the correlativity. 

According to the fifth aspect of the present invention, there 
is provided a computer readable medium storing thereon a program 
for causing a computer to function as: appending information 
generating means for receiving image data and generating appending 
information based on contents of the image data; correlativity 
judgment means for judging correlativity between the image data 
and another image data including the appending information based 
on the appending information; and correlativity information 
assignment means for assigning correlativity information 
indicating the correlativity to the received image data and the 
other image data. 

According to the sixth aspect of the present invention, there 



is provided a computer readable medium storing thereon a program 
for causing a computer to function as: appending information 
generating means for generating appending information based on 
contents of an image data when the image data is received; 
correlativity judgment means for judging a correlativity between 
the image data and another image data from which the appending 
information is generated based on the appending information; and 
maintenance judgment means for judging whether the image data is 
to be maintained based on the correlativity. 

The summary of the invention does not necessarily describe 
all necessary features of the present invention. The present 
invention may also be a sub-combination of the features described 
above . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic diagram of an information processing 
system. 

Fig. 2 is a functional block diagram of image processing 
apparatus. 

Figs. 3A and 3B are tables exemplary showing information 
attached by appending information attaching means. 

Fig . 4 is a table exemplary showing correlativity information 
judged by correlativity judgment means. 

Fig. 5 is a table exemplary showing information attached 
by composite means and maintenance judgment means. 

Fig. 6 is a flow chart indicating operating sequence of the 
image processing apparatus. 

Fig. 7 is a drawing exemplary showing a hardware 
configuration of the image processing apparatus. 

DETAILED DESCRIPTION OF THE INVENTION 



The invention will now be described based on the preferred 
embodiments, which do not intend to limit the scope of the present 
invention, but exemplify the invention. All of the features and 
the combinations thereof described in the embodiment are not 
necessarily essential to the invention. 

Fig. 1 is a schematic diagram of an information processing 
system 10. It is an object of the information processing system 
10 to judge the correlativity between a plurality of image data 
in an image processing apparatus. Accordingly, the information 
processing system 10 transfers an image data having a low 
correlativity with the other image data, so that the processing, 
such as image composition, is performed between the image data 
having high correlativity. 

The information processing system 10 includes image 
processing apparatuses 20A, 20B and 20C which connect with one 
another through a network. Each of the image processing 
apparatuses 20A, 20B and 20C includes a plurality of image data 
and process the image data. Moreover, the image processing 
apparatuses 20A, 20B and 20C transfer the image data to and from 
one another when necessary. 

Alternatively, each of the image processing apparatuses 2 OA, 
20B and 20C is a server computer provided as a single unit composed 
in a body casing or a computer system constituted by a plurality 
of computers. Moreover, according to Fig. 1, although the 
information processing system 10 includes three separate image 
processing apparatuses 20, it may include one computer system in 
another example . In this case, the information processing system 
10 virtually separates the computer system to three virtual spaces 
using a software, so that these virtual spaces function as the 
respective image processing apparatuses 20A, 20B and 20C. 

Fig. 2 is a functional block diagram showing the image 
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processing apparatus 20A. The image processing apparatus 20A 
includes a data storage unit 100, selection means 210, appending 
information generating means 220, appending information attaching 
means 230, correlativity information assignment means 240, 
5 composite means 250, maintenance judgment means 260, and a 

communication unit 270. Since configuration of each of the image 
processing apparatus 20B and the image processing apparatus 20C 
is substantially the same as that of the image processing apparatus 
20A, the explanation of the image processing apparatuses 20B and 

10 20C will be omitted. 

The data storage unit 100 stores a plurality of image data 
110. For example, image data 110A is a still image photographed 
by a camera of a user, or. a movie played with information such 
as sound or characters. For example, the data, such as image data 

15 recorded in a memory of a digital camera, image and sound data 
in a memory of a camera module of a portable telephone, and image 
data of a digital television, which is transmitted by electric 
wave and recorded in a memory, are input into the image processing 
apparatus 20A by the user, and the image and sound data become 

20 the image data 110. 

The data storage unit 100 transmits the image data to the 
selection means 210 or the composite means 250 according to the 
demand from the selection means 210 or the composite means 250. 
Moreover, the data storage unit 100 maintains the image data or 

25 deletes the image data in the data storage unit 100 according to 
an instruction from the communication unit 270. Since the image 
data HOB and the image data HOC has substantially the same as 
the image data 110A, the explanation of the image data HOB and 
HOC will be omitted. 

30 If the selection means 210 receives an image data selection 

instruction instructing to select additional image data from the 
communication unit 270, the selection means 210 selects the image 
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data additionally received by the communication unit 270 from the 
data storage unit 100, and sends it to the appending information 
generating means 220. Moreover, if the selection means 210 
receives the additional image data selection instruction, the 
selection means 210 judges the correlativity between, the image 
data and the image data in the data storage unit 100 which includes 
the appending information. The selection means 210 selects the 
image data from the data storage unit 100 r the image data having 
a higher correlativity than a predetermined value with the 
appending information received from the appending information 
attaching means 230. Then, the selection means 210 sends the 
selected image data to the correlativity information assignment 
means 240. 

In this way, the selection means 210 select s ' another image 
data , of which thecorrelativityistobej udgedby the correlativity 
information assignment means 240., using at least a part of the 
appending information. Alternatively, if the total number of the 
image data in the data storage unit 100 is less than a predetermined 
number, the selection means 210 selects the image data,, of which 
the correlativity is less than the predetermined value, and sends 
it to the correlativity information assignment means 240. 

The appending information generating means 220 receives the 
image data from the selection means 210, and generates the appending 
information by analyzing the contents of the image data. Then, 
the appending information generating means 220 sends the image 
data and the generated information to the appending information 
attaching means 230 as the appending information. 

After the appending information attachingmeans 230 receives 
the image data and the appending information from the appending 
information generating means 220, the appending information 
attaching means 230 attaches the appending information to the image 
data. Then, the appending information attaching means 230 sends 



the image data, to which the appending information is attached, 
to the correlativity information assignment means 24.0. 

For example, if the image data is handled as a file by an 
operating system, the appending information attaching means 230 
attaches the appending information by writing the received 
appending information in the file of the image data. Moreover, 
the appending information attaching means 230 stores the appending 
information in an area in the data storage unit 100 and writes 
the information about the storage area of the appending information 
to the image data, so as to refer the user to the image data easily. 

In this case, the appending information attaching means 230 
translates the appending information into a language such as XML 
which is exchangeable between different plat forms ,. and attaches 
it to the image data. In this case, the appending information 
attaching means 230 attaches information indicating a protocol 
standard indicating the form of the data. Alternatively, the 
appending information attaching means 230 embeds the appending 
information in the image data using so called the digital 
watermarking technology . 

A correlativity judgment means 235 receives the image data 
from the appending information attaching means 230 (to be referred 
to as "main image data" hereafter) , and receives at least one image 
data from the selection means 210 (to be referred to as "sub image 
data" hereafter). Then, the correlativity . j udgment means 235 
judges the correlativity between the main image data and the sub 
image data based on the appending information associated with these 
image data. Then, the correlativity judgment means 235 sends the 
main image data, the sub image data, and the information on the 
correlativity associated with the sub image data to the 
correlativity information assignment means 240. 

Moreover, the correlativity j udgment means 235 sends an image 
data additional selection instruction, which instructs to select 
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an additional image data of which the cor relativity is to be j udged, 
to the selection means 210 according to the result of the 
correlativity judgment. Alternatively , if the correlativity 
between the main image data and the sub image data has been already 
attached to these image data, the correlativity judgment means 
235 omits the judgment of the correlativity. 

The correlativity information assignment means 240 assigns 
the received correlativity information to both the main image data 
and the sub image data. Then, the correlativity information 
assignment means 240 sends both the main image data and the sub 
image data to each of the composite means 250 and the maintenance 
judgment means 2 60. 

The composite means 250 receives the main image data and 
the sub image data from the correlativity information assignment 
means 240. Then, the composite means 250 selects one of the sub 
image data based on the correlativity information assigned to each 
of the main image data and the sub image data. Then, the composite 
means 250 composes the selected sub image data and the main image 
data, and stores it. in the data storage unit 100. 

The maintenance judgment means 260 receives the main image 
data and the sub image data from the correlativity information 
assignment means 240. Then, the maintenance judgment means 260 
judges whether to maintain the main image data based on the 
correlativity information assigned to the main image data and the 
sub image data. The maintenance judgment means 2 60 sends an 
instruction ordering the transference of the main image data with 
the main image data to the communication unit 270, and sends an 
instruction to delete the main image data to the data storage unit 
100, so as to delete the main image data from the image processing 
apparatus 20A. 

The communication unit 270 transmits the image data to the 
image processing apparatus 20B, the image processing apparatus 
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20C, etc. , on receiving the instruction to transfer the image data 
with the image data . Moreover , the communication unit 27 0 receives 
the image data from the image processing apparatus 20B and the 
image processing apparatus 20C, and stores the data storage unit 
100 with the image data. Then, every time the communication unit 
270 receives the image from the image processing apparatus 20B 
and the image processing apparatus 20C, the communication unit 
270 sends a selection instruction of the image data to the selection 
means 210. As another example of the timing for transmitting the 
selection instruction of the image data, every time the 
communication unit 27 0 receives a predetermined number of the image 
data from the image processing apparatus 20B and the image 
processing apparatus 20C, the communication unit 270 sends the 
image data selection instruction . That is> the communication unit 
27 0 causes the selection means 210 to repeat the processing whenever 
the contents of the data storage unit 100 is changed more than 
a predetermined amount. Alternatively, the communication unit 
270 transmits the image data to another image processing apparatus 
according to electronic signature information, which is associated 
with the image data in advance. For example, if the electronic 
signature information does not permit a certain image processing 
apparatus to process the image data, the communication unit 270 
transmits the image data to another image processing apparatus. 

In this way, the image processing apparatus 20A composes 
the images based on the correlativity between the selected image 
data and the other image data. As a result, the image processing 
apparatus 20A uses the image data having high correlativity for 
the image processing such as image composition by transferring 
the image data having low correlativity with the other image data 
to another image processing apparatuses. 

Figs . 3A and 3B are tables exemplary showing the information 
attached by the appending information attaching means 230. Fig. 
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3A is a table exemplary showing the appending information attached 
by the appending information attaching means 230, In Fig. 3A, 
the appending information attaching means 230 associates contents 
and processing conditions of the image with an image data 
5 identification number. For example, the appending information 
generating means 220 generates information indicating that the 
image is x> a group photo" by analyzing the image of "Image No. 1". 
Then, the appending information attaching means 230 attaches 
Contents information "group photo" to the image of "Image No. 1". 

10 Similarly, the appending information generating means 220 

generates the image processing conditions indicating that the image 
is preferably printed at a size larger than or equal to A4 size, 
by analyzing the image of "Image No. 1". Then, the appending 
information attaching means 230 attaches the image processing 

15 condition to the image of "Image No. 1". As another example of 
. the information to be generated, the appending information 
generating means 220 generates the information indicating a scene 
of the subject . For example, the appending information generating 
unit 220 generates information indicating "portrait", or 

20 information indicating "moon over a mountain". 

In this way, the appending information attaching means 230 
provides the contents of the image and/or the processing conditions 
of the image to a user. 

Fig. 3B shows another example of the appending information 

25 attached by the appending information attaching means 230. The 
appending information attaching means 230 attaches a plurality 
of appending information to the image data, the appending 
information indicating the contents of the image data, such as 
brightness, size of subject and manufacturer of film. 

30 Alternatively, as another example of the appending information 
attached by the appending information attaching means 230, the 
appending information attaching means 230 attaches information 



such as information of photographer presumed from owner of the 
digital camera, photography date, and/or information on 
photography equipment, based on the information of the EXIF form 
attached at the time of the image data generation. In this case, 
the appending information attaching means 230 provides the user 
with an analysis result of the image data, which has been analyzed 
from a plurality of viewpoints, with the image data, in a 
multidimensional vector. 

Fig. 4 is a table exemplary showing the correlativity 
information provided by the correlativity information assignment 
means 240. The correlativity judgment means 235 judges the 
correlativity between the image of " Image No. 1" (e.g., the main 
image data), and each of the images of " Image. No. 2" and "Image 
No. 3" (e.g., the sub image data ) , which are the other image data, 
and converts the correlativity to a numerical value . For example, 
since both "Image No. 1" and "Image No. 2" shown in Fig. 3B are 
photographed using films manufactured by the same f ilmmanuf acturer , 
the correlativity judgment means 235 evaluates the correlativity 
between these two images to be 65. Then, the correlativity 
information assignment means 240 assigns the correlativity 
information to the main image data in association with the 
identification information of the sub image data, of which the 
correlativity is to be judged. 

In this way, the correlativity information assignment means 
240 assigns the correlativity information to both the image data 
and the other image data of which the correlativity is to be judged . 

Fig. 5 is a table exemplary showing information attached 
by the composite means 250 and the maintenance judgment means 2 60 . 
The composite means 250 and the maintenance judgment means 260 
attach a processing history as shown in the Fig. 5 to the image 
data of which the image identification information is "Image No. 
1". That is, if the maintenance judgment means 260 judges that 
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the image data is not to be stored and transfers the image data 
to another image processing apparatuses, the maintenance judgment 
means 260 attaches information identifying an origin image 
processing apparatus of the image data, and information identifying 
a destination image processing apparatus of the imag.e data to the 
image data in association with date of the transference. For 
example, as shown in Fig. 5, when the image data of "Image No. 
1" is transferred from the image processing apparatus 20B to the 
image processing apparatus 20C, the maintenance judgment means 
2 60 attaches the identification information of the image processing 
apparatus 20B, which is the origin of the image data, and the 
identification information of the image processing apparatus 20C, 
which is the destination of the image data, in association with 
the date "2001/5/30", which is the date of the transference, to 
the image data of "Image No. 1". 

On the other hand, if the image data is composed or processed 
(e.g. , printing of the image) , the composite means 250 associates 
information about apparatus by which the composition and the 
processing is performed (e.g., the printing apparatus) and date 
(e.g., printing date) with detailed information about the 
composition and the processing (e.g., detailed information for 
printing) , and attaches them to the image data. For example, if 
20 sheets of the image data of "Image No. 1" are printed at standard 
size by the image processing apparatus 20B on April 1, 2001, the 
composite means 250 associates "image processing apparatus 20B", 
which is the printing apparatus, and "2001/4/1", which is the 
printing date, with "2 0- sheet standard size" , which is the detailed 
information for printing, and attaches them to the image data of 
"Image No. 1". As another example of the detailed information 
for printing, the composite means 250 attaches information, such 
as information of a photo shop, delivery date of the photograph, 
and/or a price of the photograph. 



In this way, the composite means 250 and the maintenance 
judgment means 260 attach the processing history, such as 
transference history or the printing history, to the image data 
as the additional information. Therefore, even if the composite 
means 250 is toprocess the image data which is additionally received 
by the image processing apparatus, the processing optimized for 
the image data is performed by referring to the processing history 
of the image data. 

Fig. 6 is a flow chart indicating operating sequence of the 
image processing apparatus 20A. The selection means 210 selects 
an image data (e.g., the main image data) according to the 
instructions from the communication unit 270 (S100) . Then, the 
appending information generatingmeans 220 generates the appending 
information by analyzing the main image data (S110), and the 
appending information attaching means 230 attaches the appending 
information to the main image data . The selection means 210 selects 
the image data (e.g., the sub image data) , of which the correlativity 
with the main image data is to be judged (S120) . If the selection 
means 210 judges that the correlativity between the main image 
data and the sub image data is higher than a predetermined reference 
value (S130: YES), the correlativity information assignment means 
240 provides both the main image data and the sub image data with 
the correlativity information on the main image data and the 
correlativity information on the sub image data, which is data 
used for the correlativity judgment (S140) . Then, the 
correlativity judgment means 235 selects the sub image data, of 
which the correlativity is to be judged, more than a predetermined 
number, and j udges whether the correlativity has been judged "(S150) . 
If the correlativity judgment means 235 judges that the 
correlativity of the predetermined number of the sub image data 
has not been judged (S150: NO), the sequence returns to S120. 

In this way, the selection means 210 repeats to select the 



image data until it selects the image data, of which the 
correlativity is higher than the predetermined reference value, 
more than the predetermined number. 

Then, based on the correlativity information on the main 
image data and the sub image data, if the maintenance judgment 
means 260 judges that the main image data is not to be maintained 
(S160: NO), it deletes the main image data from the data storage 
unit 100 and causes the communication unit 270 to transmit the 
main image data to another image processing apparatus (S170) . For 
example, the maintenance judgment means 260 judges that the main 
image data is not to be maintained if only the sub image data, 
of which the correlativity with the main image data is lower than 
the predetermined reference value, is received. More 
particularly, as the predetermined reference value, if an average 
of the correlativity between the main image data and the sub image 
data is less than an average of the correlativity among the image 
data in the image processing apparatus 20A, the maintenance 
judgment means 260 judges that the main image data is not to be 
maintained .'■ 

Moreover, if needed, based on the correlativity information, 
the composite means 250 composes the main image data and the sub 
image data to generate a new image data (S180) , and store it in 
the data storage unit 100. For example, if the main image data 
is a landscape and the sub image data is a portrait, the composite 
means 250 composes the person and the scenery. Alternatively, 
if the sub image data is a template for. image ornament, the composite 
means 250 selects the sub image data suitable for a template of 
the main image data based on the correlativity information, and 
composes them. 

In this way, based on the image data, the image processing 
apparatus 20A generates the appending information and the 
correlativity information, and attaches them to the image data. 
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Moreover, as shown in Fig. 6, the image processing apparatus 20A* 
does not have to judge the correlativi ty between the image data 
andall the other image data in the data storage unit 100 . Therefore, 
the image processing apparatus 20A neglects a part of the image 
5 data, of which the correlativity is to be judged, according to 
performance of hardware which realizes the image processing 
apparatus 20A. ; 

Fig. 7 is a drawing exemplary showing a hardware 
configuration of the image processing apparatus 20A. According 

10 to the present embodiment, the image processing apparatus 20A 
includes: a CPU peripheral unit including CPU 1000, RAM 1020, a 
graphic controller 1075, and a displaying apparatus 1080, which 
are mutually connected to one another through a host controller 
10 82 ; an input -and- out put unit including a communication interface 

15 1030, a hard disk drive 1040, and a CD-ROM drive 1060 which are 
connected to the host controller 1082 through an input/output 
controller 1084; and a legacy input-and-output unit including ROM 
1010, a flexible disk drive 1050, and an input-and-output chip 
1070 which are connected to the input/output controller 1084. 

20 The host controller 1082 connects the RAM 1020, with the 

CPU 1000 and the graphic controller 1075 which access to the RAM 
1020 at a high transfer rate. The CPU 1000 operates based on the 
program stored in the ROM 1010 and the .RAM 1020 to control each 
part. The graphic controller 1075 acquires the image data 

25 generated by the CPU 1000 or the like in frame buffer in the RAM 
1020, and causes the displaying apparatus 1080 to display the image 
data. Alternatively, the graphic controller 1075 includes the 
frame buffer for storing the image data generated by the CPU 1000 
or the like. 

30 The input/output controller 1084 connects the host 

controller 1082 with the communication interface 1030, the hard 
disk drive 1040, and the CD-ROM drive 1060 , which are comparatively 
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high speed I/O devices. The communication interface 1030 
communicates with other apparatuses, such as the image processing 
apparatus 20B or the image processing apparatus 20C, through a 
network. The hard disk drive 1040 stores program and data which 
is used by the image processing apparatus 20A. The CD-ROM drive 
1060 reads program and/or data in a CD-ROM 1095, and provides the 
input -and- output chip 107 0 with the program and/ or the data through 
the RAM 1020. 

Moreover, the ROM 1010 and comparatively low speed I/O 
devices, such as the flexible disk drive 1050 and the 
input-and-output chip 1070, are connected to the input/output 
controller 1084. The ROM 1010 stores a boot program executed by 
the CPU 1000 during startup of the image processing apparatus 20A, 
a program depending on the hardware of the image processing 
apparatus 20A, etc. The flexible disk drive 1050 reads program 
or data in a flexible disk 1090, and provides the input-and-output 
chip 1070 with it through the RAM 1020. The input-and-output chip 
1070 connects various kinds of I/O devices through the flexible 
disk 1090, a parallel port, a serial port, a keyboard port , a mouse 
port, etc. Moreover, the input-and-output chip 1070 receives data 
corresponding to a user 1 s input from an Input device, and provides 
it to the program executed by the image processing apparatus 20A. 

The program provided to the image processing apparatus 20A 
is stored in a record medium, such as the flexible disk 1090, the 
CD-ROM 1095 or an IC card, which are provided by the user. The 
program is read from the record medium, installed in the image 
processing apparatus 20A through the input-and-output chip 1070, 
and executed by the image processing apparatus 20A. 

■The program realizing the image processing apparatus 20A 
includes a data storage module, a selection module, an appending 
information generating module , an appending information attaching 
module, a correlativity judgment module, a correlativity 
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information assignment module, a composite module, a maintenance 
judgment module, and a communication module. These modules are 
programs for causing the image processing apparatus 2 OA to function 
as the data storage unit 100, the selection means 210/ the appending 
information generating means 220, the appending information 
attaching means 230, the correlativity judgment means 235, the 
correlativity information assignment means 240, the composite 
means 250, the maintenance judgment means 260, and the 
communication unit 270. 

The program or the module shown above is stored in an external 
storage medium. It is possible to use an optical record medium 
such as DVD or PD, a magneto- optical record medium such as Minidisk, 
a tape medium, a magnetic record medium or a semiconductor memory 
such as an IC card or a Miniature Card as a record medium instead 
of the flexible disk 1090 and the CD-ROM 1095. A storage device, 
such as a hard disk or RAM in a server system on a dedicated 
communication network or the Internet, may be used as a record 
medium and the program may be provided to the. image processing 
apparatus 20A via the communication network. 

Since a hardware configuration of each of the image 

» 

processing, apparatus 20B and the image processing apparatus 20C 
is substantially the same as that of the image processing apparatus 
20A, the explanation of the image processing apparatuses 20B and 
20C will be omitted. 

It is obvious from the above explanation that the information 
processing system 10 judges whether the image data is to be 
maintained in the image processing apparatus, or it is to be 
transferred to another image processing apparatuses, based on the 
correlativity between the image data and the other image data. 
Therefore, the information processing system 10 transfers the image 
data among the plurality of image processing apparatuses, and 
collects the image data having a high correlativity with each of 
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the image processing apparatus as a result. Therefore, the 
information processing system 10 appropriately processes the image 
data by composing the image data with another image data having 
high correlativity with the image. 

As described above , according to the present invention, there 
is provided the image processing apparatus for appropriately 
processing the image. 

Although the present invention has been described by way 
of an exemplary embodiment, it should be understood that those 
skilled in the art might make many changes and substitutions without 
departing from the spirit and the scope of the present invention. 
It is obvious from the definition of the appended claims that 
embodiments with such modifications also belong to the scope of 
the present invention. 



